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Abstract 

Test functions are important to validate new optimization algorithms 
and to compare the performance of various algorithms. There are many 
test functions in the literature, but there is no standard list or set of test 
functions one has to follow. New optimization algorithms should be tested 
using at least a subset of functions with diverse properties so as to make 
sure whether or not the tested algorithm can solve certain type of opti- 
mization efficiently. Here we provide a selected list of test problems for 
unconstrained optimization. 
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In order to validate any new optimization algorithm, we have to validate it against 
standard test functions so as to compare its performance with well-established or existing 
algorithms. There are many test functions, so there is no standard list or set of test functions 
one has to follow. However, various test functions do exist, so new algorithms should be 
tested using at least a subset of functions with diverse properties so as to make sure whether 
or not the tested algorithm can solve certain type of optimization efficiently. 

In this appendix, we will provide a subset of commonly used test functions with simple 
bounds as constraints, though they are often listed as unconstrained problems in literature. 
We will list the function form f(x), its search domain, optimal solutions a;* and/or optimal 
objective value /*. Here, we use x = (xi, ...,x n ) T where n is the dimension. 



Ackley's function: 
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where n = 1,2,..., and -32.768 < x { < 32.768 for i = 1,2,..., n. This function has the 
global minimum /* = at x* = (0, 0, 0). 



De Jong's functions: The simplest of De Jong's functions is the so-called sphere function 

n 

/(*) = $>?, -5.12 < Xi < 5.12, (2) 

i=i 

whose global minimum is obviously /* = at (0, 0, ...,0). This function is unimodal and 
convex. A related function is the so-called weighted sphere function or hyper-ellipsoid 
function 

n 

f(x) = Y J ixl -5.12 < x, < 5.12, (3) 
i=i 

which is also convex and unimodal with a global minimum /* = at x* = (0, 0, ...,0). 
Another related test function is the sum of different power function 

n 

f{x) = Y J \x i \ l+ \ -l<Xi<l, (4) 
i=i 

which has a global minimum /* = at (0, 0, 0). 



Easom's function: 



cos(x) cos(y) exp — (x — 7r) 2 + (y — tt) 
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whose global minimum is /* = —1 at x* = (tt,tt) within —100 < x,y < 100. It has many 
local minima. Xin-She Yang extended in 2008 this function to n dimensions, and we have 
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whose global minimum /* = —1 occurs at x* = (tt, tt, tt). Here the domain is — 2tt < 
Xi < 2tt where i = 1,2, n. 



Equality-Constrained Function: 
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1=1 

subject to an equality constraint (a hyper-sphere) 
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The global minimum = —1 of f(x) occurs at x*(l/yjn, \j^fn) within the domain 
< Xi < 1 for i = 1, 2, n. 

Griewank's function: 

1 11 n x 

f( x ) = e x i - n c ° s (^) + !. - 6o ° < ^ < 6o °' (9) 

whose global minimum is /* = at x* = (0,0, ...,0). This function is highly multimodal. 
Michaelwicz's function: 

n ^ 2 

f( x ) = ~ E sin (^) • sin(— 5-) 
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where m = 10, and < x\ < it for i = 1, 2, n. In 2D case, we have 



f(x,y) = — sin(x) sin 20 ( — ) — sin(y) sin 2U (^-), 
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where (x,y) G [0,5] x [0,5]. This function has a global minimum /* ps —1.8013 at 
= (z*,y*) = (2.20319,1.57049). 



Perm Functions: 
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which has the global minimum = at x* = (1, 2, n) in the search domain — n < x,- L < n 
for i = 1, n. A related function 



f(*) = it{ib( i +f 3 ){ x i-(h j ]} 2 , 



(13) 
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has the global minimum /* = at (1, 1/2, 1/3, 1/n) within the bounds —1 < Xi < 1 for 
all i = 1,2, ...,n. As /3 > becomes smaller, the global minimum becomes almost indistin- 
guishable from their local minima. In fact, in the extreme case (3 = 0, every solution is also 
a global minimum. 



Rastrigin's function: 
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f{x) = 10n + [ x i ~ 1° cos(27rxi)] , -5.12 < x t < 5.12, 
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whose global minimum is /* = at (0, 0, 0). This function is highly multimodal. 



Rosenbrock's function: 

71-1 



fix) = ]T [( Xi - l) 2 + 100(x i+1 - x 2 ) 2 ] , (15) 



i=i 

whose global minimum /* = occurs at x* = (1, 1, 1) in the domain — 5 < Xj < 5 where 
i = 1,2, n. In the 2D case, it is often written as 

f(x,y) = (x-l) 2 + 100(y-x 2 ) 2 , (16) 

which is often referred to as the banana function. 

Schwefel's function: 

n 

f(x) = -J2 x i sin (\f\%i\), -500 <x;< 500, (17) 
i=i 

whose global minimum /* « — 418.9829n occurs at Xj = 420.9687 where i = 1,2, ...,n. 
Six-hump camel back function: 

fix, y) = (4 - 2.1x 2 + ix 4 )x 2 + xy + 4(y 2 - l)y 2 , (18) 

where — 3 < x < 3 and —2<y<2. This function has two global minima /* « —1.0316 at 
(x*,y*) = (0.0898,-0.7126) and (-0.0898,0.7126). 

Shubert's function: 

n n 

fix) = [j2icos(i + ii + l)x)] ■ [2icos(i + (i + l)y)], (19) 
i=i i=i 

which has 18 global minima /* w —186.7309 for n = 5 in the search domain —10 < x, y < 10. 
Xin-She Yang's functions: 

n n 

/(x) = (^|x J |)exp[-^sin(x 2 )], (20) 
i=i i=i 

which has the global minimum /* = at = (0,0, ...,0) in the domain — 2ir < Xj < 2ir 
where i = 1,2, n. This function is not smooth, and its derivatives are not well defined at 
the optimum (0, 0, 0). 
A related function is 

n n 

/(aO = -(EN) ex P(-E^)> -10<xi<10, (21) 
i=i i=i 

which has multiple global minima. For example, for n = 2, we have 4 equal minima 
/* = -l/v^~ -0.6065 at (1/2,1/2), (1/2,-1/2), (-1/2,1/2) and (-1/2,-1/2). 



Yang also designed a standing-wave function with a defect 

f(x) = [e" Er =1 (^//3) 2m _ 2e ^ E: =1 *?] . C o S 2 Xi , m = 5, 
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which has many local minima and the unique global minimum /* = — 1 at a;* = (0, 0, 0) 
for /3 = 15 within the domain —20 < X{ < 20 for i = 1, 2, n. 

The location of the defect can easily be shift to other positions. For example, 
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f(x)= [ e -Er =1 (W/3) 2 -_ 2e -Er =1 (— ) 2 ] .Jlcos 2 ^, m = 5, 
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has a unique global minimum /» = -1 at a; t = {it, ir, it) 
Yang also proposed another multimodal function 

n n n 

f(x) = {[^sin 2 (xi)] -exp(-^x 2 )} -exp [-^sin 2 y>^], (24) 

i=l i=l i=l 

whose global minimum /* = —1 occurs at x* = (0,0,..., 0) in the domain —10 < X{ < 10 
where i = 1,2, n. In the 2D case, its landscape looks like a wonderful candlestick. 

Most test functions are deterministic. Yang designed a test function with stochastic 
components 

K K 

f(x, y) = -5e-M*-*) a +(v-*) 2 ] - E E e^-^^ 2 ^-^ , (25) 

j=l i=l 

where a, (3 > are scaling parameters, which can often be taken as a = f3 = 1. Here e^- 
are random variables and can be drawn from a uniform distribution ~ Unif[0,l]. The 
domain is < x, y < K and K = 10. This function has K 2 local valleys at grid locations 
and the fixed global minimum at x* = (vr,7r). It is worth pointing that the minimum f m \ n 
is random, rather than a fixed value; it may vary from — {K 2 + 5) to —5, depending a and 
/3 as well as the random numbers drawn. 

Furthermore, he also designed a stochastic function 

n 
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— 5 < X{ < 5, 
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where ej (i = 1, 2, n) are random variables which are uniformly distributed in [0, 1]. That 
is, ej ~Unif[0, 1]. This function has the unique minimum /* = at x* = (1, 1/2, 1/n) 
which is also singular. 

Zakharov's functions: 

/(*) = E ^ 2 + ( 2 E ^) + (2 E **) > ( 27 ) 

i=l i=l i=l 

whose global minimum /* = occurs at x* = (0, 0, 0). Obviously, we can generalize this 
function as 



n K 

f(x) = j2x 2 + j24 k , 
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where if = 1,2, ...,20 and 
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